Mathematical model in which relationships determine meaning
When the meaning is a vector of higher dimensions, the relationship is determined by the operations between the vectors.
This is the mathematical model found in word2vec and others If the vectors are orthogonal, there is no relationship.
What kind of mathematical model is this?
These two symbols are related, and are passed
But this is what word2vec does internally.
The word "this word is related" is presented with the co-occurrence of the word in the window.
---
This page is auto-translated from /nishio/関係が意味を決める数理モデル. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.